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DETAILED ACTION 
The Final Rejection of 8/5/08 

[01 ] In accordance with CFR §1 .78(a)(5)(iii), the application has the priority date of 9/5/2002. For at least 
this reason, the Hale reference (2003/01 14730) is not prior art, and the rejections under 103(a) are 

withdrawn. 

[02] This Office action is to replace the Office action of 8/5/08. 

Drawings 

[03] The objection to the drawings set forth in the Office action of 1/1 6/08 is withdrawn in view of the 
cancellation of claim 20. 

Claim Rejections - 35 USC § 103 

[04] The text of those sections of Title 35, U.S. Code not included in this action can be found in a prior 
Office action. 

[05] Claims 14-17, 19, 21-25, 27-28 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Chen (6,702,736) in view of Hoeg (6,371 ,909) and in further view of Fukunaga (6,346,940). 

[06] With regard to claim 14: 

[06a] Chen discloses a method for improving a medical procedure; comprising: 

• providing an endoscope ("endoscope 90" 4/48) having a shaft with a longitudinal axis 
and a variable view vector (see Figure 11); 

• positioning the endoscope relative to an anatomical structure to acquire images of the 
structure; 

• providing a first display of the images acquired by the endoscope ("video image data 
210 obtained from endoscope 90" 9/25); 
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• providing a second display of a graphical model of the anatomical structure ("computer 
model image data 220" 9/26) simultaneously with the first display of the images of the 
anatomical structure acquired by the endoscope ("composite image 200" 9/24), 
wherein the graphical model is reconstructed from volumetric scan data of the 
anatomical structure ("anatomical 3-D computer models 160" 8/24); 

• acquiring position data of the endoscope relative to the anatomical structure ("tracking 
system 97" 3-19). 

• displaying a graphical model of the endoscope relative to the anatomical structure 
based on the position data and the volumetric scan data (see Figure 9 with reference 
to (10/35-41); 

[06b] Chen does not disclose: 

• that the variable view vector pivots relative to the longitudinal axis of the shaft; 

• acquiring configuration data of the orientation of the view vector relative to the 
longitudinal axis of the endoscope shaft as the view vector pivots relative to the shaft; 

[06c] Hoeg discloses: 

• a variable view vector that pivots relative to the longitudinal axis of the shaft of an 
endoscope ("optical path portion 46" 4/28) and acquiring configuration data of the 
orientation of the view vector relative to the longitudinal axis of the endoscope shaft as 
the view vector pivots relative to the shaft ("sensors or other devices that provide 
rotational position signals to a video monitor, with the video monitor providing a 
numerical, graphical, or other representation of the viewing angle" 6/20-26). 
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• At the time of tfie invention, it would tiave been obvious to a person of ordinary sl<ill in 
the art to enable a variable view vector such as that disclosed by Hoeg in the 
endoscope disclosed by Chen. A skilled artisan would be motivated to do so for the 
reasons stated in 5/25-30 of Hoeg: "Failure to know precisely the direction in which the 
endoscope is looking can complicate a procedure." 

[06d] Chen in view of Hoeg does not disclose: 

• displaying a graphical representation of the endoscope in the second display; 

• displaying in the second display a graphical model of the view vector relative the 
longitudinal axis of the endoscope based on the configuration data. 

[06e] Fukunaga discloses: 

• providing a first display of the images acquired by an endoscope ("main display 1 1a 
which displays an endoscopic image Ai" 5/54); 

• displaying in a second display a graphical model of an anatomical structure 
("subdisplay 1 1 b which displays an outer shape image Bi" 5/55) 

• displaying in the second display a graphical representation of the endoscope relative 
to the anatomical structure based on the position data and the volumetric scan data 
("indicator image Ci" 8/61-67) 

• displaying in the second display a graphical representation of the view vector ("red bar 
37" 8/63) relative the longitudinal axis of the endoscope based on the configuration 
data. 

• At the time of the invention, it would have been obvious to a person of ordinary skill in 
the art that to combine anatomic visualization system disclosed by Chen with the 
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graphical representation of an endoscope relative to an anatomical structure as 
disclosed by Fukunaga. It is obvious to combine prior art elements according to 
known methods to yield predictable results. In combination, the anatomic visualization 
system and the graphical representation of an endoscope would have perfonned the 
same function as they had separately; a skilled artisan would have recognized that the 
result of the combination was predictable. 
[07] With regard to claim 1 5: As noted above, Fukunaga discloses displaying on the second display a 
graphical representation of the endoscopic view vector. Chen discloses a cone sun'ounding the 
view vector based on known "optical properties" of the endoscope (see Figure 1 1 ). A view cone, in 
addition to the vector disclosed by Fukunaga would offer the obvious advantage of borders of the 
displayed portion (see "software object 90B'" in Figure 4). 
[08] With regard to claim 1 6: Fukunaga further discloses displaying on the second display a marker that 
indicates the up direction of the images acquired by the endoscope ("green hemisphere 35... 
indicates the reference direction" 8/65-67). 
[09] With regard to claim 1 7: As noted above, Chen in view of Fukunaga discloses first and second 
displays are displayed on a single monitor. It would have been obvious to display them on first and 
second monitors, since it has been held that mere duplication of the essential working parts of a 
device involves only routine skill in the art. St. Regis Paper Co. v. Bemis Co., 193 USPQ. 
Constructing two monitors having a single display each instead of a single monitor having two 
displays is essentially equivalent and well within the abilities of a skilled artisan. 
[1 0] With regard to claim 1 9: Chen further discloses selecting a target point relative to the reconstructed 
anatomical structure ("markers 30E'" 11/45); and calculating a set of endoscope tip positions from 
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which there is a direct line of sight to the target point. In the course of rendering target points within 
the first and second displays, Chen inherently calculates an endoscope tip position from which there 
is a direct line of sight to the target point (as in Figure 12). Given that the target point will be 
rendered from any vantage point having a direct line of sight to the target point, there will inherently 
be a set of endoscope tip positions which is calculated in the normal course of use. 
[1 1 ] With regard to claim 21 : Chen in view of Fukunaga further discloses: selecting an entry path for the 
endoscope ("plan a surgical procedure" 1 1/46); calculating which of the endoscope tip positions for 
which there is a direct line of sight to the target point are intersected by the entry path (see Figure 
12); and displaying the endoscope tip positions that are intersected by the entry path (see Figure 
12). 

[12] With regard to claim 22: 

[1 2a] Chen discloses a method for improving a medical procedure; comprising: 

• providing an endoscope ("endoscope 90" 4/48) having a shaft and a distal end with a 
longitudinal axis and a variable view vector (see Figure 11); 

• positioning the endoscope relative to an anatomical structure to acquire images of the 
structure; 

• providing a first display of the images acquired by the endoscope ("video image data 
210 obtained from endoscope 90" 9/25); 

• providing a second display of a graphical model of the anatomical structure ("computer 
model image data 220" 9/26) simultaneously with the first display of the images of the 
anatomical structure acquired by the endoscope ("composite image 200" 9/24), 
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wherein tine graphical model is reconstructed from volumetric scan data of the 
anatomical structure ("anatomical 3-D computer models 160" 8/24); 

• acquiring position data of the endoscope relative to the anatomical structure ("tracking 
system 97" 3-19). 

• displaying a graphical model of the endoscope relative to the anatomical structure 
based on the position data and the volumetric scan data (see Figure 9 with reference 
to (10/35-41); 

[1 2b] Chen does not disclose: 

• that the variable view vector pivots relative to the longitudinal axis of the shaft; 

• acquiring configuration data of an internal view changing mechanism in the distal end 
of the shaft that pivots the view vector pivots relative to the longitudinal axis of the 
shaft; 

[12c] Hoeg discloses: 

• a variable view vector that pivots relative to the longitudinal axis of the shaft of an 
endoscope ("optical path portion 46" 4/28) and acquiring configuration data of the 
orientation of the view vector relative to the longitudinal axis of the endoscope shaft as 
the view vector pivots relative to the shaft ("sensors or other devices that provide 
rotational position signals to a video monitor, with the video monitor providing a 
numerical, graphical, or other representation of the viewing angle" 6/20-26). 

• At the time of the invention, it would have been obvious to a person of ordinary skill in 
the art to enable a variable view vector such as that disclosed by Hoeg in the 
endoscope disclosed by Chen. A skilled artisan would be motivated to do so for the 
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reasons stated in 5/25-30 of Hoeg: "Failure to Icnow precisely the direction in which the 
endoscope is looking can complicate a procedure." 
[1 2d] Chen in view of Hoeg does not disclose: 

• displaying a graphical representation of the endoscope in the second display; 

• displaying in the second display a graphical model of the view vector relative the 
longitudinal axis of the endoscope based on the configuration data. 

[12e] Fukunaga discloses: 

• providing a first display of the images acquired by an endoscope ("main display 1 1 a 
which displays an endoscopic image Ai" 5/54); 

• displaying in a second display a graphical model of an anatomical structure 
("subdisplay 1 1 b which displays an outer shape image Bi" 5/55) 

• displaying in the second display a graphical representation of the endoscope relative 
to the anatomical structure based on the position data and the volumetric scan data 
("indicator image Ci" 8/61-67) 

• displaying in the second display a graphical representation of the view vector ("red bar 
37" 8/63) relative the longitudinal axis of the endoscope based on the configuration 
data. 

• At the time of the invention, it would have been obvious to a person of ordinary skill in 
the art that to combine anatomic visualization system disclosed by Chen with the 
graphical representation of an endoscope relative to an anatomical structure as 
disclosed by Fukunaga. It is obvious to combine prior art elements according to 
known methods to yield predictable results. In combination, the anatomic visualization 
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system and the graphical representation of an endoscope would have performed the 
same function as they had separately; a skilled artisan would have recognized that the 
result of the combination was predictable. 

[1 3] With regard to claim 23: As noted above, Fukunaga discloses displaying on the second display a 
graphical representation of the endoscopic view vector. Chen discloses a cone surrounding the 
view vector based on known "optical properties" of the endoscope (see Figure 1 1 ). A view cone, in 
addition to the vector disclosed by Fukunaga would offer the obvious advantage of borders of the 
displayed portion (see "software object 90B'" in Figure 4). 

[14] With regard to claim 24: Fukunaga further discloses displaying on the second display a marker that 
indicates the up direction of the images acquired by the endoscope ("green hemisphere 35... 
indicates the reference direction" 8/65-67). 

[1 5] With regard to claim 25: As noted above, Chen in view of Fukunaga discloses first and second 
displays are displayed on a single monitor. It would have been obvious to display them on first and 
second monitors, since it has been held that mere duplication of the essential working parts of a 
device involves only routine skill in the art. St. Regis Paper Co. v. Bemis Co., 193 USPQ. 
Constructing two monitors having a single display each instead of a single monitor having two 
displays is essentially equivalent and well within the abilities of a skilled artisan. 

[1 6] With regard to claim 27: Chen further discloses selecting a target point relative to the reconstructed 
anatomical structure ("markers 30E'" 11/45); and calculating a set of endoscope tip positions from 
which there is a direct line of sight to the target point. In the course of rendering target points within 
the first and second displays, Chen inherently calculates an endoscope tip position from which there 
is a direct line of sight to the target point (as in Figure 12). Given that the target point will be 
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rendered from any vantage point having a direct line of sight to the target point, there will inherently 
be a set of endoscope tip positions which is calculated in the nonnal course of use. 
[1 7] With regard to claim 28: Chen in view of Fukunaga further discloses: selecting an entry path for the 
endoscope ("plan a surgical procedure" 1 1/46); calculating which of the endoscope tip positions for 
which there Is a direct line of sight to the target point are intersected by the entry path (see Figure 
12); and displaying the endoscope tip positions that are intersected by the entry path (see Figure 
12). 

Additional Claim Rejections - 35 USC § 103 

[18] Claims 18, 26 are rejected under 35 U.S.C. 103(a) as being unpatentable over Chen (6,702,736) in 
view of Hoeg (6,371 ,909) and Fukunaga (6,346,940) and in further view of Schuiz (5,920,395). 

[1 9] Chen discloses that "tracking system 97 might comprise an optical tracking system" (5/26-27). 
Chen does not disclose that "tracking system 97" particularly comprises a plurality of cameras to 
track light emitting diodes on the endoscope. 

[20] Schuiz discloses that "[tjhree light sensors 20, 22, and 24 sense the light projected by the individual 
light emitters 14, 16 and generate electrical output signals from which are derived the location of the 
probe 12 and, consequently, the probe tip 18, with respect to the fixed coordinate system 80" (5/30- 
35). Schuiz further discloses that the light emitter may be LEDs (7/10). 

[21] At the time of the invention, it would have been obvious to a person of ordinary skill in the art that 
the optical tracking system disclosed by Schuiz be substituted for the optical tracking system 
disclosed by Chen. It is obvious to substitute one known element for another to obtain predictable 
results. Optical tracking systems are known in the art, as are camera/LED optical tracking systems. 
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A skilled artisan could have substituted one for the other, and the resulting substitution would have 
been predictable. 

Response to Arguments 

[22] Applicant's arguments with respect to the claims have been considered but are moot in view of the 
new ground(s) of rejection. 

Conclusion 

[23] Applicant's amendment necessitated the new ground(s) of rejection presented in this Office action. 
Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). Applicant is reminded of the 
extension of time policy as set forth in 37 CFR 1 .136(a). 

[24] A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the 
mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date 
of this final action and the advisory action is not mailed until after the end of the THREE-MONTH 
shortened statutory period, then the shortened statutory period will expire on the date the advisory 
action is mailed, and any extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the 
mailing date of the advisory action. In no event, however, will the statutory period for reply expire 
later than SIX MONTHS from the date of this final action. 

[25] Any inquiry concerning this communication or earlier communications from the examiner should be 
directed to PHILIP R. SMITH whose telephone number is (571)272-6087 and whose email address 
is philip.smith@uspto.gov. The examiner can normally be reached between 9:00am and 5:00pm. 

[26] If attempts to reach the examiner by telephone are unsuccessful, the examiner's supervisor, Linda 
Dvorak can be reached on (571) 272 4764. 
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[27] Information regarding the status of an application may be obtained from the Patent Application 

Information Retrieval (PAIR) system. Status information for published applications may be obtained 
from either Private PAIR or Public PAIR. Status information for unpublished applications is 
available through Private PAIR only. For more infonnation about the PAIR system, see http://pair- 
direct.uspto.gov. Should you have questions on access to the Private PAIR system, contact the 
Electronic Business Center (EBC) at 866-217-9197 (toll-free). 

/Philip R Smith/ 

Examiner, Art Unit 3739 

/Linda C Dvorak/ 

Supervisory Patent Examiner, Art Unit 3739 



